CSISZÁR’S f -DIVERGENCES - BASIC PROPERTIES
نویسنده
چکیده
In this talk basic general properties of f -divergences, including their axiomatic, and some important classes of f -divergences are presented. Without essential loss of insight we restrict ourselves to discrete probability distributions and note that the extension to the general case relies strongly on the Lebesgue-Radon-Nikodym Theorem.
منابع مشابه
f-DIVERGENCES: SUFFICIENCY, DEFICIENCY AND TESTING OF HYPOTHESES
This paper deals with f -divergences of probability measures considered in the same general form as e.g. in [12] or [45], where f is an arbitrary (not necessarily differentiable) convex function. Important particular cases or subclasses are mentioned, including those introduced by Bhattacharyya [3], Kakutani [32], Shannon [61] and Kullback with Leibler [38], Chernoff [7], Kraft [37], Matusita [...
متن کاملRisk-Based Generalizations of f-divergences
We derive a generalized notion of f divergences, called (f, l)-divergences. We show that this generalization enjoys many of the nice properties of f -divergences, although it is a richer family. It also provides alternative definitions of standard divergences in terms of surrogate risks. As a first practical application of this theory, we derive a new estimator for the Kulback-Leibler divergenc...
متن کاملOn Shore and Johnson properties for a Special Case of Csiszár f-divergences
—The importance of power-law distributions is attributed to the fact that most of the naturally occurring phenomenon exhibit this distribution. While exponential distributions can be derived by minimizing KL-divergence w.r.t some moment constraints, some power law distributions can be derived by minimizing some generalizations of KL-divergence (more specifically some special cases of Csiszár f-...
متن کاملDynamics of spontaneous symmetry breaking in the Weinberg-Salam theory
Solving for p,p' gives (2) The need for fundamental scalar fields in the theory of weak and electromagnetic forces' is a serious flaw. Aside from the subjective esthetic argument, there exists a real difficulty connected with the quadratic mass divergences which always accompany scalar fields. ' These divergences violate a concept of naturalness which requires the observable properties of a the...
متن کاملDivergences and Risks for Multiclass Experiments
Csiszár’s f -divergence is a way to measure the similarity of two probability distributions. We study the extension of f -divergence to more than two distributions to measure their joint similarity. By exploiting classical results from the comparison of experiments literature we prove the resulting divergence satisfies all the same properties as the traditional binary one. Considering the multi...
متن کامل